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Abstract 


^  A  nonlinear  0-1  program  can  be  restated  as  a  multilinear  0-1 
program,  which  in  turn  is  known  to  be  equivalent  to  a  linear  0-1  program 
with  generalized  covering  (g.c.)  inequalities.  In  a  companion  paper  [6] 
we  have  defined  a  family  of  linear  inequalities  that  contains  more 
compact  (smaller  cardinality)  linearizations  of  a  multilinear  0-1  program 
than  the  one  based  on  the  g.c.  inequalities.  In  this  paper  we  analyze  the 
dominance  relations  between  inequalities  of  the  above  family.  In  particular, 
we  give  a  criterion  that  can  be  checked  in  linear  time,  for  deciding  whether 
a  g.c.  inequality  can  be  strengthened  by  extending  the  cover  from  which  it 
was  derived.  We  then  describe  a  class  of  algorithms  based  on  these  results 
and  discuss  our  computational  experience.  We  conclude  that  the  g.c.  in¬ 
equalities  can  be  strengthened  most  of  the  time  to  an  extent  that  Increases 
with  problem  density.  In  particular,  the  algorithm  using  the  strengthening 
procedure  outperforms  the  one  using  only  g.c.  inequalities  whenever  the 
number  of  nonlinear  terms  per  constraint  exceeds  about  12-15,  and  the  dif¬ 
ference  in  their  performance  grows  with  the  number  of  such  terms.  _ 


NONLINEAR  0-1  PROGRAMMING : 


II.  DOMINANCE  RELATIONS  AND  ALGORITHMS 
by 

Egon  Balas  and  Joseph  B.  Mazzola 


1.  Introduction 

In  this  paper  we  discuss  solution  methods  for  the  multilinear  0-1 
programming  problem 

(MLP)  max{fQ(x) |fk(x)  <  b^,  keK,  x  binary} 

where  the  functions  fQ  and  ffc,  keK,  are  of  the  general  form 

(1)  f(x)  =  £  a  (  tt  x, ). 

jeN  3  ieQ^  1 

Here  a^,  jeN,  are  real  numbers,  and  tt  means  product.  Any  nonlinear 
0-1  program  involving  real-valued  functions  can  be  restated  in  this  form  [14] 
Applications  of  nonlinear  0-1  programming  span  many  areas.  Such 
formulations  have  been  used  in  modular  design  [7,  8],  media  selection  [22], 
project  scheduling  [17],  capital  budgeting  under  uncertainty  [16],  cluster 
analysis  [18],  diagnostic  testing  [15],  accounting  control  systems  [13], 
production  planning  in  flexible  manufacturing  systems  [19,  20],  etc. 
Quadratic  0-1  programming,  including  the  quadratic  assignment  problem, 
has  a  host  of  well  known  uses. 

In  a  companion  paper  [6]  we  have  introduced  a  new  linearization  of 
(MLP)  (first  presented  in  [4]),  which  uses  only  the  original  variables. 
Specifically,  for  a  multilinear  inequality  of  the  form 


(2) 


f(x)  =  I  a.(  tt  x. )  <  b  , 


we  defined  a  family  ?  of  linear  inequalities  equivalent  to  (2)  in  the  sense  that 
a  0-1  vector  x  satisfies  (2)  if  and  only  if  it  satisfies  every  inequality  of 
?,  and  we  identified  several  proper  subfamilies  of  ?  that  are  also  linear 
equivalents  of  (2) .  The  members  of  ?  are  associated  with  covers  for  (2) , 
and  the  subfamily  of  ‘J  corresponding  to  minimal  covers  is  the  set  of  general¬ 
ized  covering  inequalities  (set  covering  inequalities  in  the  original  variables 
and  their  complements)  shown  by  Granot  and  Hanzner  [12]  to  be  equivalent  to  (2). 
Some  other  subsets  of  ?,  associated  with  covers  for  (2)  that  are  not  minimal, 
give  more  compact  linearizations,  i.e.,  linear  equivalents  of  smaller 
cardinality. 

In  the  remainder  of  this  section  we  restate  those  results  of  [6]  that 
we  will  need  in  the  sequel.  In  section  2  we  examine  dominance  relations 
between  inequalities  of  ?,  with  a  view  toward  deriving  criteria  for  generating 
linear  equivalents  of  (2)  as  compact  as  possible.  We  first  give  a  necessary 
and  sufficient  condition  for  an  inequality  of  ?  to  imply  another  one  (with 
respect  to  binary  vectors).  We  then  show  that  a  generalized  covering 
inequality  in?,  i.e.,  a  member  of  ?  associated  with  a  minimal  cover  M  for 
(2),  can  be  strengthened  by  including  into  M  certain  indices  j«N\M  if 
and  only  if  an  easily  verifiable  condition  holds. 

In  section  3  we  introduce  a  class  of  algorithms  for  solving  multi¬ 
linear  0-1  programs,  based  on  these  results.  Like  the  earlier  procedure 
of  Granot  and  Granot  [9]  (see  also  [10,  11]),  our  algorithms  generate 
linear  inequalities  sequentially  from  those  constraints  of  (MLP)  violated 
by  the  current  solution  until  such  time  when  an  optimal  binary  solution 
to  the  current  linear  constraint  set  satisfies  all  constraints  of  (MLP); 
such  a  solution  is  optimal  for  (MLP).  However,  while  the  procedure  of 


[9,  10,  11]  uses  generalized  covering  inequalities  only,  the  main  version 
of  bur  algorithm  generates  stronger  inequalities  whenever  they  are  obtain¬ 
able  via  the  criteria  outlined  above.  Our  algorithms  use  as  a  subroutine 
the  0-1  (linear)  programming  heuristic  of  Balas  and  Martin  [3]. 

Section  U  discusses  our  computational  experience  on  randomly  generated 
multilinear  0-1  programs  with  up  to  20  constraints,  50  variables,  and  60 
nonlinear  terms  per  constraint.  In  particular,  an  algorithm  that  uses  the 
results  of  this  paper  to  generate  strengthened  linear  inequalities  is  compared 
to  one  that  uses  only  generalized  covering  inequalities,  like  the  procedure 
of  [9,  10,  11].  The  algorithm  that  uses  only  generalized  covering  inequalities 
did  better  on  problems  that  had  on  the  average  less  than  12  nonlinear  terms 
per  constraint,  whereas  the  one  that  uses  the  strengthened  inequalities  did 
better  on  the  problems  that  had  on  the  average  16  or  more  nonlinear  terms  per 
constraint.  Furthermore,  the  difference  in  performance  tends  to  increase 
sharply  with  the  number  of  terms  per  constraint. 

We  also  present  computational  results  concerning  the  use  of  the 
procedure  as  a  heuristic.  Typically,  the  heuristic  solutions  obtained  were 
(guaranteed  to  be)  within  3%  of  optimality,  and  for  those  cases  in  which 
the  optimal  solution  was  known,  the  heuristic  solution  was  on  the  average 
within  0.257.  of  the  optimal  integer  solution.  In  the  heuristic  mode,  our 
algorithm  is  able  to  solve  substantially  larger  problems  than  those  noted 
above,  and  does  so  in  a  reasonable  amount  of  time  with  practically  acceptable 
accuracy  bounds. 

The  results  of  this  paper  were  circulated  under  [5], 

Given  a  multilinear  inequality  (2),  let 

N+  =  {jcN|a  >  0}, 


N'  -  { j  «N | a  <  0}  , 


f  (x)  =  E  .  a ,  (  TT  x. )  , 
j8N  J  ieQj 


f  (x) 


E  _  a  (  n  x  ) 
jeN  J  lcQj  1 


For  any  McN,  let  Q  =  U  Q  ,  Q  =  Q  ,  and  q  =  |Q(.  Let  $"  be  the 

j  eM  J  N 

family  of  mappings  cp  that  associate  to  every  jeN”  some  ieQ^,  and  for  each 
<pe$,  let 

“i00  ■  jV  v«j>  • 

For  any  cpei”,  let  be  the  range  of  cp,  i.e.. 


Qjp3  {i«Q i i  =  <P(j)  for  some  jeN  }  . 


A  set  MCN  is  said  to  be  a  cover  for  the  inequality  (2)  if 

£  |.  |  >b  -  E  .  .  . 

jeM  J  jeN  J 

A  cover  M  is  minimal  if  T  is  not  a  cover  for  anv  T  C  M. 

Thus,  a  set  MSN  is  a  cover  for  the  inequality 

(2+)  f+(x)  <  b 

if  and  only  if 

E  a  >  b  , 
jeM  J 

L.e.,  if  and  only  if  MUN“  is  a  cover  for  (2).  We  will  denote 
Z-  (MCN+|M  is  a  cover  for  (2+) }  . 

For  any  x^  e{0,l},  the  complement  of  x^  Is  defined  to  be  x^  =  1  -  j 
The  following  result  (Theorem  11  of  [6]),  presented  here  without 


proof,  is  fundamental  in  defining  the  family  J  of  linear  inequalities 
equivalent  to  the  multilinear  inequality  (2). 


Theorem  1.  The  vector  x  e{0,l}q  satisfies  (2)  if  and  only  if  it 
satisfies 

<3)„  I  J +  Z  ^ it  >  «“ 

for  every  M  e  C,  cpe$  ,  where 


M 


I  aj  "  b  , 


jeM 


M  ,  ;  M  «c 

=  minia0,  ^ 


-  a  }, 

jeM|ieQj  J 


ieQ, 


•M 


and 


,  M  _ — 
0  *  min  {a  ,  2ZZ 

^  ^  i  -IT 


’ 

jcN  |i=i(j)  J 


icQ 


9 


Denoting  by  3  the  family  of  inequalities  (3)M  ^  for  all  M  eC-  and 
cpef”,  Theorem  1  states  that  the  multilinear  inequality  (2)  is  equivalent 
to  the  system  of  linear  inequalities  defined  by  3. 

Now  let  MeC<  and  qie$-  be  such  that  Q„DQ  ^  0,  i.e.,  there  exists 

Pl  5p 

some  ieQ„HQ  ,  for  which  both  x.  and  x.  have  positive  coefficients  in  (3)„  . 

M  cp  11  M,Cp 

Then  (3)M  remains  essentially  the  same  (in  the  sense  of  having  the  same 

M,  Cp 

solution  set)  if  min{o^,  |3^}  is  subtracted  from  a^,  from  |3^  and  from  Og.  But 

M 

then  all  those  remaining  coefficients  <*j ,  j  r  i  and  (3^*  k  f  i,  whose  value 
exceeds  the  new  right  hand  side,  (c*g)  '  =  Oq  -  tnin(a^,  9^3  >  can  be  replaced 
by  (<*q)  ' •  Thus  the  presence  of  indices  allows  an  inmediate 

(trivial)  strengthening  of  the  inequality  (3)M 

For  any  ep«§”  ,  if  M  «C-  is  such  that  the  set  M  u  N-  is  a  minimal  cover 
for  (2),  then  the  linear  inequality  (3)^  ^  resulting  from  Theorem  1  is  readily 


seen  to  be  of  the  form 


Furthermore,  for  any  such  set  M,  if  M  and  cp  are  such  that  ^  0, 

the  inequality  (4)^  ^  is  vacuous.  Thus  the  only  inequalities  (4)^  ^  of 


interest  are  those  such  that  Q  0Q 

M 


0  • 


The  multilinear  inequality  (2)  is  also  shown  in  [6]  to  be  equivalent 
to  the  system  of  multilinear  inequalities  (each  having  all  positive 
coefficients)  defined  by 


(5) 


f  (*)  +  2 

j  eN" 


a  x  .  .  <  b  - 
i  jl  «p(j)  - 


jeN 


‘j  * 


for  all  cpe$”.  Thus,  replacing  (2)  by  all  inequalities  (5)^,  cpei”,  and  then 
generating  the  sets  of  linear  inequalities  equivalent  to  each  inequality 
(5)  ,  results  in  a  family  ?  =  U  8  of  linear  inequalities  which  linearizes 


cp' 


cpcS 


<P 


(2).  In  fact,  we  observed  in  [6]  that  the  previously  defined  family  3  is 
properly  contained  in?;  namely,  while?  contains  an  inequality  for  every 
cover  of  (2),  S  contains  an  inequality  only  for  every  cover  of  (2+) . 

The  inequalities  in  ?  corresponding  to  minimal  covers  of  (2)  are  the 
generalized  covering  inequalities  known  to  be  equivalent  to  (2).  Thus  all 
members  of  ?  that  are  not  generalized  covering  inequalities  correspond  to 
covers  of  (2)  that  are  not  minimal. 

We  are  now  prepared  to  investigate  the  relative  strength  of  inequalities 


(3),.  derived  from  covers  M  that  are  minimal  and  those  that  are  not. 

M,cp 


2.  Dominance  Relations 

An  inequality  A  is  said  to  dominate  an  inequality  B  if  every  nonnegative 
x  satisfying  A  also  satisfies  B.  Further,  A  strictly  dominates  B,  if  A 
dominates  B  and  there  exists  some  nonnegative  x  that  satisfies  B  but  not  A. 

We  shall  also  find  it  useful  to  define  the  following  weaker  notion  of  dominance. 


An  inequality  A  is  said  to  c-dominate  an  inequality  B  if  every  0-1 
point  x  satisfying  A  also  satisfies  B.  Further,  A  strictly  c-dominates  B, 
if  A  c-dominates  B  and  there  exists  some  0-1  point  satisfying  B  but  not  A. 

It  is  easily  verified  that  an  inequality  A  can  c-dominate  an  inequality  B 
without  A  dominating  B,  whereas  the  converse  is  of  course  false.  It  is 
also  easily  verified  that  A  c-dominates  B  if  and  only  if  every  cover  for  B 
is  a  cover  for  A,  and  A  strictly  c-dominates  B  if  and  only  if  A  c-dominates 
B  and  there  exists  a  cover  for  A  that  is  not  a  cover  for  B.  Hence  the  term 
c-dominance. 

We  will  occasionally  call  an  inequality  A  stronger  than  B  if  A  strictly 
c-dominates  B. 

We  have  seen  that  the  inequalities  of  the  family  if  are  intimately 
related  to  covers  for  the  multilinear  inequality  (2).  In  the  context  of 
linear  inequalities,  it  is  known  [1,  2]  that  canonical  inequalities  derived 
from  minimal  covers  can  usually  be  strengthened,  and  can  never  be  weakened 
by  extending  the  covers.  Unfortunately  in  the  case  of  nonlinear  inequalities, 
only  the  first  part  of  this  statement  is  true:  extending  a  minimal  cover  may 
weaken  the  inequality  associated  with  it. 

Example  1.  To  show  that  extending  a  minimal  cover  can  actually  weaken 
the  inequality  derived  from  the  cover,  let 

7x2x5x6  +  6x1x;Jx^  +  5x2x^  +  2x1x;J  <  12, 

with  =  {2,5,6},  Q2  =  {1,3,4},  =  {2,4}  and  =  {l , 3 } .  Applying  Theorem  1 

and  using  the  minimal  cover  M  =  {2,3,4},  we  obtain  the  inequality 

X1  +  x2  H'  *3  +  x4  -  1 

Mow,  extending  the  minimal  cover  M  to  {1,2, 3, 4],  we  obtain  the  inequality 


8x.  +  8x.  +  8x-  +  8x,  +  7x,  +  7x,  >  8, 


which  is  actually  weaker  than  (strictly  c-dominated  by)  the  first  inequality. || 

Fortunately,  the  phenomenon  illustrated  by  Example  1  can  be  precisely 

characterized.  Next  we  address  the  practically  important  question  as  to  when 

an  inequality  (3)^  where  M  eC,  can  be  strengthened  by  expanding  the  cover  M. 

We  will  assume  that  cpe§"  is  given,  and  therefore  will  write  (3)^  for 

(3)..  .  and  6,  for  gf  .  From  the  discussion  at  the  end  of  section  1  it  should 
M,*P  1  I 

be  clear  that  the  presence  of  indices  denoting  the  presence  of 

positive  coefficients  for  both  x^  and  x^,  denotes  a  "weakness"  of  the  in¬ 
equality  (3)m>  in  that  it  allows  for  a  trivial  strengthening.  We  will 

therefore  assume  that  M  is  chosen  such  that  Q-.OQ  -  0,  and  furthermore 

M  Cp 

that  M  is  expanded  into  a  set  R  such  that  QR  D  *  9  too. 

In  what  follows,  summation  over  the  empty  set  is  taken  to  yield  0. 

First  we  give  a  necessary  aad  sufficient  condition  for  an  inequality 

(3)  E  afx  +  E  P.x.  > 

R  icQR  11  icQ^  1  1  _  0 

to  c-domlnate  the  inequality  (3)M,  where  M«C  and  MCRcN+.  For  any  0-1 
vector  x  with  support  Q(x)  *  T,  the  difference  between  the  values  of  the 
right  hand  side  and  the  left  hand  side  of  (3)R  is 


*<T)R  " 


ieQR\T 


while  the  corresponding  difference  for  (3)^  is 


A(T)  =  a*  -  Z==  p 

U  i eQw  xT  1  isQ  HI  1 


Clearly,  the  inequality  (3)R  ((3)M>  is  violated  by  x  if  and  only 
if  A(T)r  >  0  (A(T)m  >  0). 

By  definition,  the  inequality  (3)R  c-dominates  (3>M  if  and  only  if 
every  0-1  vector  x  that  violates  (3)^  also  violates  (3)R.  Hence  (3)R 
c-dominates  (3)M  if  and  only  if 

(6)  A(T)r  >  0  for  all  T  C  Q  such  that  A(T>M  >  0. 

Condition  (6)  can  be  used  to  prove  the  following  dominance  property 
for  inequalities  of  the  type  under  discussion. 

Theorem  2.  Let  M  eC-  and  MCRSN+.  The  inequality  (3)R  c-dominates 
(3)m  if  and  only  if 

(7)  5HI  (lQ.\Tl  -  l)a  <  A(T)m 

jeRM  J  J 

for  all  TCQ^UQ^  (including  T  =  0)  such  that  A(T)M  >  0. 

Proof.  We  will  show  that  the  condition  of  the  Theorem  is  equivalent 
to  (6).  From  the  definitions  (see  Theorem  1), 


R  _  M  ^ 

<*o  ~  ao  +  s 


jeR\M 


Further,  for  ieQM>' 


K.  ,  r  M  .  ^ -  „  ii  , 

x  =  min{an  +  ^ a.  +  ^ 
jeRM  J 


M 


jeR\M  ieQ 


j 


3j} 


=  aM  +  2 


1  jeR\M|ieQ.  j 


.  .  M  M. 
(since  oti  <  q^)  , 


10 


and  for  leQR\QM. 


af  =  +  > -  a  ,  a  } 

1  u  jeR\M  J  jeR\M|ieQj  J 


=  ST.~—  a  . 
j  eR\M)ieQ^  J 


(8) 


Thus  for  any  TcQ, 


A(T)„  =  A(T)„  + 


-  ZZZ  (X 


■<) 


M  JcR\M  j  ieQR\T  jeRXMlieQ^  j 

-  A(T)  +  7ZZ  a,  -  ?  \Q1  \T\a 

M  j  eR\M  j  j«R\M  j  J 


and  therefore  condition  (6)  holds  if  and  only  if  (7)  holds  for  all  TCQ  such 
that  A(T)m  >  0. 

It  remains  to  be  shown  that  (7)  holds  for  all  TCQ  such  that  A(T)M  >  0 
if  and  only  if  It  holds  for  all  TS^UQ^  such  that  A(T)M  >  0.  The  "only  if" 
part  Is  obvious.  To  show  the  "if"  part,  let  TqcQ,  t0  * Q„  U  Q^,  be  such  that 

mVm  >  °»  and  let  Ti  "  Ton  (qmu  V*  Then  a(Vm  =  a(ti)m*  and  since  ®j  >  ° 

for  all  jeR  and  T^Tg,  If  (7)  is  violated  for  T  =  TQ,  it  is  also  violated  for 


T 


Given  a  cover  M,  Theorem  2  can  In  principle  be  used  to  find  an 
extension  R  of  M  (if  one  exists),  such  that  the  inequality  (3)R  c-dominates 
(3)^.  However,  the  condition  of  Theorem  2  is  in  general  not  easy  to  check. 
We  will  show  below  that  for  the  family  of  covers  M  that  are  minimal,  the 
condition  of  Theorem  2  reduces  to  a  simpler  one,  which  can  be  checked  in 
linear  time.  Before  discussing  that  case,  however,  we  wish  to  note  that. 


unlike  in  the  case  of  the  sequential  lifting  procedures  for  linear  in¬ 
equalities  in  0-1  variables  (see,  for  instance,  [1]),  if  one  wishes  to 
strengthen  an  inequality  (3)^  by  expanding  the  cover  M  into  a  larger  cover 
R  with  the  required  properties,  this  cannot  always  be  done  sequentially, 
i.e.,  by  introducing  the  elements  of  R\M  one  at  a  time.  This  is  illustrated 
by  the  following  example. 

Example  2.  In  the  inequality 

8x^2  +  5xjX^  +  5XjX^  +  4x2*2*^  +  X3X5  +  X4X6  — 

let  the  sets  Q^,  j  =  1,...,6,  be  indexed  from  left  to  right.  Taking 
M  =  {1,2, 3, 4],  we  obtain  the  inequality 

10x^  +  IOX2  +  4x^  +  4x^  +  5Xg  +  5xg  >  10. 

If  we  attempt  to  expand  M  by  setting  R  *  MU  {5},  condition  (7)  is  not 
met  for  T  =  {3,5}.  Similarly,  if  we  set  R  *  MU  {6},  (7)  is  violated  for 
T  =  {4,6}.  However,  if  we  set  R  =  MU  {5,6},  then  (7)  is  satisfied  for  all 
T  such  that  MT)m  >  0.|| 

For  any  MsC,  let  C(M)  =  MUN  .  As  mentioned  earlier,  C(M)  is  a  cover 

for  (2)  if  and  only  if  Mefl.  If  C(M)  is  a  minimal  cover  for  (2),  M  is  a 

minimal  cover  for  (2+)  (but  the  converse  is  not  necessarily  true). 

We  now  focus  on  the  case  when  C(M)  is  a  minimal  cover  for  (2).  Recall 

M  if  M 

from  section  1  that  in  this  case  -  (3^  *  ckq  for  all  ieQ^  and  jeQ^  in  (3)^  ^ 
Further,  if  Qj^Q^  t  0>  then  (3)M  ^  is  vacuous. 

Corollary  2.1.  Let  MCRsN+,  Q  HQ  =  0,  and  let  C(M)  be  a  minimal 

K  9 

cover  for  (2).  Then  the  inequality 


12- 


c-dominates  (3)M  if  and  only  if 


16VQM 


R  .  R 

ai  <  a0  * 


Further,  (3)D  strictly  c-dominates  (3)  if  and  only  if  (9)  holds 
R  M 

R  R  R 

and  either  ak  <  aQ  for  some  k  c  or  P^  <  aQ  for  some  l  e . 

M  M 

Proof.  If  C(M)  is  a  minimal  cover  for  (2),  then  since  c*t  *  Pj  =  ao» 
*  i  €Qm,  jeQ^,  from  the  definition  of  A(T>M  it  follows  that  A(T)M  >  0 
implies  (Qm\T)  U  (Q^DT)  *  0  and  A(T)M  -  Further,  for  any  TCC^UQ^, 

A(T)„  >  0  implies  T  =  Q„.  Therefore  in  this  case 

5  |Q,\T|a  =  Z.. . —  O  - a  ), 

jeRNM  2  J  ieQ^Qjj  jeR\M|ieQj  J 

and  thus  condition  (7)  of  Theorem  (2)  becomes 


■  ■  ,  —  ®j)  <  a0  +  ^ -  a< 

jeR\M  icQ.  J  jcR\M  J 


ieQR\QM  j  eR\MjieQj  j‘ 


which  is  the  same  as  (9).  Thus  (9)  is  necessary  and  sufficient  for  (3)R  to 
c-dominate  (3)^. 

Assume  now  that  (3)R  strictly  c-dominates  (3)M.  Then  there  exists 
a  0-1  vector  x  with  support  Q(x)  -  T  that  satisfies  (3)M  but  not  (3)R.  Thus 

there  exists  either  k  c  C^XT  such  that  o£  <  a*.  or  XeQ^PT  such  that  <  a 

Conversely,  if  there  exists  k  e  such  that  <  Qfg,  then  xC  '  «  (o,i}q 
defined  by  Q(x°)  *  Q\{k}  satisfies  (3)M  but  not  (3)R;  and  if  there  exists 
l  cQ  such  that  P.  <  then  x*  e  [0,l}q  defined  by  Q(x*)  *  {&}  satisfies 

(3)m  but  not  (3)R. || 

An  important  practical  consequence  of  Corollary  2.1,  which  is  used 

in  the  Algorithm  of  the  next  section,  can  be  stated  as  follows.  For  M £ N+, 

we  define 


os  o 


Et(M)  «  {J«N+|  |Qj\Qm|  =  i},  i  55  0,1 . . 

where  p  =  max  1QAQm|,  and  denote  E(M)  =  En(M)UE.(M).  (This  set  E(M)  is  the 
j«N  J  u  1 

same  as  the  one  used  in  [6].) 

Corollary  2,2.  Let  M  and  R  be  as  in  Corollary  2.1.  If  RCE(M), 
then  (3)_  c-dominates  (3)w. 

K  M 

Proof.  Let  RcE(M)  and  denote  Rt  =  R  fl  E^(M) ,  i  =  0,1.  Then  R  *  RqU^ 

and 

fo  for  j  eR- 

J  II  for  j«R1 


Hence 


"5 -  R-r  _  M  ,  _  R 

^  ai  ~  ^  ai  <  a0  +  ^  ai-Qro 
ieQR\QM  J  °  jeR  J  0 

i.e.,  condition  (9)  of  Corollary  2.1  is  satisfied.il 

Thus  any  minimal  cover  MCN+  for  (2+)  can  safely  be  extended  to 
include  all  terms  in  E(M),  without  weakening  the  inequality  (3)„.  The 
computational  effort  required  to  identify  E(M)  and  extend  M  to  E(M)  is  linear 
in  q.  However,  we  can  often  go  beyond  E(M),  as  will  be  clear  when  we  restate 
Corollary  2.1  in  slightly  different  form. 

Corollary  2.3.  Let  M  and  R  be  as  in  Corollary  2.1,  and  let 
R^  =  RflE^(M),  i  *  l,...,p.  Then  the  inequality  (3)R  c-dominates  (3)^  if 
and  only  if 


Z  [(i  -  1)  Z  aj  <  Z  a  -  b. 


Further,  (3)R  strictly  c-dominates  (3)^  if  and  only  if  (10)  holds 
and  either 


*  a  >  b 

j  «R|k|Q  3 


for  some  k  c  Q,,,  or 


-14- 


E  a  +  < -  a 

j«R  J  jcN"lW(j)  J 


for  some  -t  e  Q„. 

9 


Proof.  We  show  that  conditions  (10),  (11)  and  (12)  are  equivalent 
to  the  conditions  of  Corollary  2.1. 

For  i  *Qr\Qm, 


R  _ _ 

<*i  *  - - -  a,  -  ?  a  (since  for  jcM,  i/*Q.), 

JeR'vMlieQj  J  jeR|ieQj  3  J 


while 


«b  "  Z  ai  “  b’ 
jeR  J 


Thus  condition  (9)  of  Corollary  2.1  amounts  to 


(~.:-  of  ->  i  ~ ,  ■  ■  (v  —  1 

leQRXQM  leQRXQM 


j^R'(QRXV^j|aj<^R  V  b  C  .J). 


Now  R 


iIJo  Rt,  and  for  jeR^  1  n Qj  l  =  i.  i  =  0,1 . . 


Hence  (13)  can  be  written  as 


2  a .+  I  (i  Z  a  )  <  E  a  +  E  a  +  E  (  E  a  )  -  b 
j«R1  J  i*2  jeRi  J  j«RQ  ■’  jeR1  J  i-2  jeRj^  J 


or,  equivalently. 


I  a .  - 


b  >  Z  (IE  a  ) 
i=2  j  eRj^  J 


-  E  (  2  V 
i-2  j  eR,  J 


I  [  (i  -  1)  E  a  J  , 


'.“V"*.*’*,.**  .V***/’  .**  «  ■  .** 


which  la  precisely  (10).  Thus  (10)  is  equivalent  to  (13),  hence  to  (9),  and 
this  proves  the  first  statement. 

On  the  other  hand,  the  condition  <  or*  (for  some  keQM)  of  Corollary 
2.1  can  be  restated  as 


b 


which  is  equivalent  to  (11).  Also,  the  condition  3^  <  a q  (for  some  1  e Q^) 
can  be  written  as 


?  : . .  l »,l  <  2  a  -  b, 

jeN"|t=cp(j)  J  j«R  J 

which  is  the  same  as  (12).  This  proves  the  second  statement. || 

Condition  (10)  of  Corollary  2.3  gives  the  precise  extent  to  which  a 

minimal  cover  M  for  (2+)  (such  that  Q_.fi  Q  *  0)  can  be  extended  beyond  the 

M  cp  " 

sets  EQ(M)  and  E^M),  into  sets  E^M)  for  i  >  2.  This  is  extensively  used 
in  the  Algorithm  described  in  section  3. 

In  particular,  replacing  the  Inequality  (2)  by  the  set  of  inequalities 


(5)  f+(x)  +  Z  |a  |x  .  .  <  b  (=  b  -  Z  a  ),  cp*5', 

*  jeN-  3  jcN  J 

we  have 

Corollary  2.4.  Let  M  be  a  minimal  cover  for  (5)  for  some  <p  e  $  , 
let  MCRsN,  and  R^  =  RfiE^(M),  i  =  0,  l,...,p.  Assume  R  satisfies 
Qr  D  N+  ^  Qcp  =  '^'en  Inequality 


(14)r 


LeQRnN+ 


R  - 

ai  Xi  + 


R 

0 


c-dominates  the  generalized  covering  inequality 


i*QMnN+  1  ieQMnr 


X,  >  1 


if  and  only  if 


S  £<i  -  1)  I  a.]  <  S  a  -  b; 


and  (14)  strictly  c-dominates  (14)u  if  and  only  if  (15)  holds  and  there 
K  M 

exists  k  e  Q„  such  that 
M 


<16>  S=T—  a.  >b. 

jeRlk/tQj  J 


Proof,  Specialize  Corollary  2.3  to  inequality  (5)  .|| 

Again,  the  computational  effort  involved  in  checking  whether  condi¬ 
tions  (15),  (16)  are  satisfied  for  some  RSN^M  is  linear  in  q. 

The  following  example  illustrates  the  usefulness  of  these  results 
for  obtaining  a  more  compact  linear  system  equivalent  to  a  nonlinear 
inequality  (2)  than  the  set  of  generalized  covering  inequalities. 

Example  3.  Consider  the  multilinear  inequality 

(17)  6x.x0x,x.  +  4x,x  -  3x_x,x,  +  2x,x„x,x,  +  2x„x,x„  <  7. 

1234  15  346  1247  3  4  8  — 

This  Inequality  is  equivalent  to  the  system  defined  by  the  six  generalized 
covering  inequalities 


X-  +  X-  +  X,  +  X.  +  x_  +  X. 

1  2  3  4  5  6 


X1  +  x2  +  x3  +  x4  +  x5 


+  Xj  +  Xj  +  x^  +  Xj 


x^  +  x2  +  x^  +  x^  +  x6  +  x^ 


x.  +  x-  +  x_  +  x. 
12  3  4 


+  x6  +  X8 


X1  +  x2  x3  +  X4  +  X5  +  X6  +  X7  +  X8 


•  *  v*  -  • .  * o  •*  o  •  •  •  •  •  -/»  ■  i  /  «■  t "  s,*  «*  . •  •  •  OC  v*  •  «»*'••  *.  .  *,  »v  .  •  •  •  *  *■  ’ 


derived  from  the  minimal  covers  [l,2,3],  [l,2,4],  [l,2,5],  (1,3,4],  [1,3,5] 
and  (2, 3, 4,5],  respectively,  of  the  implied  inequality 

(17) ^  6XjX2x^x^  +  4x^Xg  +  3xg  ^*1*2^4^^  2xgx^Xg  — 

The  last  generalized  covering  inequality  is  the  only  redundant  one. 

Letting  M  =  [1,2,3],  it  follows  that  *  (l, 2, 3, 4, 5, 6].  Thus 
E  (M)  =  [1,2,3]  and  E^(M)  =  [4,5].  Therefore,  letting  R  =  M U Eq(M) U E^(M) 
[l,...,5],  from  Corollary  2.2,  the  inequality 

(3)r  ^  7xj  +  7x2  +  7*2  +  7x^  +  4x5  +  3xg  +  2x^  +  2xg  >  7 

c-dominates  inequality  (3)  ,  which  is  the  first  of  the  above  six.  Since 

rl,  sp 

M  M 

the  condition  <  aQ  of  Corollary  2.1  is  satisfied  for  k  *  6,  (3)R 

strictly  c-dominates  (3)„  In  fact,  (3)_  (strictly)  c-dominates  all 

M,cp  R,Cp 

of  the  generalized  covering  inequalities  and  is  thus  equivalent  to  (21) . it 
We  conclude  this  section  by  defining  an  alternative  linearization 
of  (2).  To  be  specific,  if  we  consider  (2)  to  be  a  linear  Inequality  in 
the  0-1  variables 

y,  ■  "  ,  jeN 

J  ieQ^  1 

and  denote  it  by  (2)  ,  then  w.l.o.g.  we  may  assume  that  a.  >  0  for  all  IsN, 

y  j  J  ’ 

and  that  a^  >  a^  >  ...  >  a^.  Then  applying  the  results  of  [1,2],  we  can 
replace  (2)  by  the  equivalent  set  of  canonical  inequalities 


Here  fi(S)  is  the  extension  of  S,  defined  as 
£(S)  =  SU  [j«N\s|j  <  j1}, 

with  =  min  j;  while  •K  is  the  family  of  strong  covers  for  (2)^,  where 
a  minimal  cover  S  is  called  strong  if  there  exists  no  minimal  cover  T  *  S 
such  that  |t|  -  |sj  and  £(S)  c£(T) . 

For  any  given  S  «K,  rewriting  (18)g  in  terms  of  x,  we  can  linearize  it 
using  the  above  results.  If  we  do  this  for  every  S  sit,  we  obtain  a  new 
linearization  of  (2),  different  from  the  one  discussed  earlier.  Naturally, 
the  question  arises  as  to  how  this  new  linearization  compares  with  the  one 
discussed  above.  Both  approaches  were  implemented  and  tested,  and  the  computa¬ 
tional  results  are  reported  in  section  4. 

3.  An  Algorithm  for  Solving  Multilinear  0-1  Programs 
We  now  describe  several  variants  of  an  algorithm  for  the  problem  (MLP) 
stated  at  the  beginning  of  this  paper.  If  the  objective  function  fg  has 
rational  coefficients,  then  it  can  be  linearized  by  introducing  a  new  (integer) 
variable  z  (or  its  binary  expansion),  and  amending  the  constraint  set  by 
one  new  inequality  involving  z  and  the  nonlinear  part  of  fg.  Thus,  w.l.o.g. 
the  multilinear  0-1  program  can  be  stated  in  the  form 

Max  E  c  x 
ieQ  1  1 

(MLP)  Z  a  (  n  x.)<b.  ,  keK 

Jl«Qkj 

x.  -  0  or  1,  ieQ 


where  the  set  Q  is  now  defined  as 


The  algorithm  that  we  present  below,  like  the  one  by  Granot  and 
Granot  T9]  (see  also  [10],  and  [11]),  generates  some  linear  inequalities 
implied  by  the  constraint  set  of  (MLP),  and  solves  the  resulting  linear 
0-1  program,  which  is  a  relaxation  of  (MLP).  At  iteration  t,  let  this 
linear  0-1  program  be  denoted  (Pt).  If  an  optimal  solution  to  (Pfc)  is 
feasible  for  (MLP),  then  it  is  optimal  for  (MLP)  and  we  stop.  Otherwise 
we  generate  a  new  set  of  linear  inequalities  implied  by  the  constraints 
of  (MLP) ,  such  that  the  new  inequalities  cut  off  the  solution  to  (Pt) , 
and  solve  the  linear  0-1  program  (P  ^)  obtained  from  (P£)  by  adding 
the  new  inequalities.  Since  at  every  iteration  the  solution  to  the 
current  problem  (P£)  is  cut  off,  the  algorithm  is  obviously  finite. 

Our  procedure  differs  from  that  of  [9,  10,  11]  mainly  in  that  we  use 
a  more  compact  linearization,  based  on  the  theory  of  section  2.  To  be  more 
specific,  we  start  with  a  set  covering  inequality  associated  with  a  minimal 
cover,  but  then  use  Theorem  2  and  its  corollaries  to  extend  the  cover  so 
as  to  obtain  as  strong  an  inequality  as  the  conditions  of  the  corollaries 
perml t . 

The  reason  for  starting  with  inequalities  associated  with  minimal 
covers,  is  that  for  this  class  we  can  check  in  linear  time  whether  the 
inequality  is  dominated  by  another  one  and^ff  so,  generate  a  dominating 
inequality.  Experience  shows  that  the  proportion  of  minimal  covers  that 
can  be  extended  is  high  (90%  is  a  typical  case)  and  tends  to  increase  with 
the  number  of  terms  per  constraint.  Since  the  use  of  extended  covers  tends 
to  produce  smaller  cardinality  linear  equivalents  of  each  nonlinear  inequality, 
it  can  also  be  expected  to  reduce  the  number  of  iterations  needed  to  solve  (MLP) 


This  is  indeed  the  case,  except  for  problems  with  few  nonlinear  terms  per 
constraint,  as  shown  by  the  computational  experience  discussed  in  the  next 
section. 

While  the  procedure  outlined  above  is  finite,  it  may  take  many 
iterations.  We  found  it  therefore  preferable  not  to  solve  (Pt>  exactly 
at  every  iteration,  but  use  a  heuristic  to  find  an  approximate  solution. 

We  proceed  this  way  until,  at  some  iteration  t,  an  approximate  solution 
to  (Pfc)  is  found  to  be  feasible  to  (MLP).  At  that  point  we  replace  the 
heuristic  by  an  exact  algorithm.  The  particular  heuristic  that  we  use  on 
the  sequence  of  linear  0-1  programs  (Pt)  is  the  Pivot  and  Complement 
procedure  of  Balas  and  Martin  [3].  When  we  switch  to  an  exact  algorithm, 
we  use  a  branch  and  bound/ implicit  enumeration  procedure  implemented 
by  Clarence  H.  Martin. 

Another  deviation  from  the  above  outline  is  that  we  found  it  convenient 
to  periodically  remove  some  of  the  linear  inequalities  generated  earlier. 

This  is  done  according  to  a  particular  procedure  so  as  to  insure  that  con¬ 
vergence  is  maintained. 

Finally,  to  facilitate  the  search  for  minimal  covers  and  their  extensions, 
used  in  the  linearization  procedure,  we  start  the  algorithm  by  ordering  once 
and  for  all  the  terns  of  each  constraint  according  to  decreasing  absolute 
values  of  their  coefficients. 

As  a  starting  solution  we  use  the  optimal  solution  to  the  unconstrained 
problem,  i.e.,  x°  defined  by  x°  =  1  if  c^  >  0  and  x°  ■  0  otherwise. 

A  flowchart  of  the  algorithm  is  shown  in  Figure  1. 


Reorder  terms 


-22 


The  heart  of  our  procedure  is  of  course  the  generation  of  linear 
inequalities.  The  rules  to  be  described  below  are  essentially  based  on 
Corollary  2.4. 

First,  it  should  be  stated  that  at  every  iteration  we  generate  one 
linear  inequality  from  every  inequality  of  (MLP)  violated  by  the  current 
solution  x°,  except  for  the  first  iteration,  when  we  generate  one  linear 
inequality  (using  the  cover  M  =  N)  from  every  constraint  of  (MLP),  whether 
violated  or  not  (the  exception  was  adopted  as  a  result  of  computational 
experimentation) . 

To  describe  the  procedure,  let 

(2)  E  a  (  rr  x  )  <  b 

j  eN  J  ieQ^ 

be  one  of  the  inequalities  violated  by  x°,  and  let  |aj|  >  ja2l  >  ...  >  |an 
Denote 

P+(x°)  *  {jeN+|  7T  x.°  =  1},  P"(x°)  *=  {  j  eN- 1  0}, 

iGQj  ieQj 

with  P(x°)  =  P+(x°)  UP'(x°).  Recall  that  inequality  (2)  gives  rise  to  the 
family  of  (all  positive)  inequalities 


(5) 


cp 


£  ,  M  11  x  )  +  E 
jeN+  J  ieQj  j  eN" 


l*,l 


Vj>  £  b 


(=  b 


E  a  )  , 
j  eN"  J 


where  v  e  5  .  Define 

5"(x°)  =  e  5~|x°  violates  (5)^}. 

It  is  easy  to  show  that  3  (x°)  #  0;  in  fact,  the  algorithm  outlined 
below  generates  a  mapping  q>e3”(x°).  Thus,  given  x°  and  the  family  of 


nonlinear  inequalities  (5)^,  <p  e  $  (x°)  (corresponding  to  a  particular 
inequality  (2)  violated  by  x°) ,  our  cut  generating  algorithm  consists 
of  the  following  sequence  of  steps: 

1.  Finding  a  minimal  cover  MSP(x°)  and  a  set  of  «p( j ) ,  jeMflN”, 
such  that  x°  violates  the  corresponding  generalized  covering  inequality. 

2.  Extending  M  to  a  maximal  set  R  satisfying  condition  (15), 
and  such  that  (R\M)  £ N+. 

3.  Choosing  cp(j)  for  j eN  \R  in  a  way  that  avoids  as  much  as  possible 
producing  nonzero  coefficients  for  complementary  pairs  of  variables,  and 
using  it  to  determine  the  remaining  coefficients  of  the  inequality. 

A  discussion  of  each  step  follows. 

1.  Let  P(x°)  =  {i^,...,i  }  be  ordered  by  the  same  rule  as  N,  i.e., 
i^  <  i-k+1>  k  =  l,...,t  -  1.  Let  je[l,...,t}  be  the  largest  integer  such  that 
ij+l,#**  ,it}  is  a  cover,  and  let  l e  { j ,  j  +  l,...,t}  be  the  smallest 
integer  such  that  M  =  (i ^ ,  i^+1, . . . ,i^}  is  a  cover  for  (2).  Then,  obviously, 
M  is  minimal. 

Next  choose  <p(j)  for  jeMflN  to  be  the  first  ieQ^  such  that  x°  =  0, 
a  choice  consistent  with  the  requirement  that  cp  e  5  (x°).  For  any  cp  e  $  (x°) 
chosen  in  this  way,  M  satisfies  the  requirement  of  Corollary  2.4,  i.e., 

Si  P  N+  0 =  an<*  C^e  generalized  covering  inequality 

>  x,  +  >  x,  >  1 

1 eQMrN+  ieQMntr 

corresponding  to  M  is  violated  by  x°. 

2.  Construct  the  extension  R  of  M  into  N+  as  follows.  As  in  Section  2, 


s 


Ei(M)+  =  {jeN+|  |Qj\Qm|  -  i},  i  =  0,  1 . p, 

and  set  E(M)+  =  Eg(M)+ l)E^(M)+.  First  add  to  R  the  set  E(M)+.  Next 
for  i  *  2,...,p,  consider  the  elements  of  Ei(M)+  in  order  of  increasing 
a^,  and  include  into  R  as  many  as  can  be  included  without  violating  condi¬ 
tion  (15).  If  all  jeEi(M)+  can  be  added  to  R,  set  i  «-  i  +  1  and  repeat. 
Otherwise  stop  with  the  last  element  of  E^(M)+  whose  inclusion  into  R  does 
not  lead  to  a  violation  of  (15). 

3.  To  define  cp( j )  for  the  remaining  indices,  i.e.,  for  j eN  \R, 
we  proceed  as  follows.  Let  R  be  the  extended  set  resulting  at  the  end  of 

step  2  and  let  c^»  i  eQU{0},  be  the  corresponding  coefficient  values, 

£ 

where  R  and  the  a  are  updated  by  combining  variables  and  their  complements 
whenever  such  pairs  occur.  Since  it  is  possible  for  either  xR  or  xR  (but 
never  for  both)  to  appear  in  the  resulting  inequality  (3)„  ,  we  partition 

Q  into  QR,  Q"  and  Q°,  where  QR  =  £i  « QRlxt  appears  in  (3)R  QR  -  {i  eQR|xt 
appears  in  (3)D  and  Q°  *  Q\(Q*UQl).  We  then  choose  cp(j)  according  to 

IvjY  K  K 

the  following  rule: 


If  Qj\Qr  f  0,  let  <p(j)  be  the  first  index  in  Q^\Qr. 

If  but  Qj  n(^R  +  let  'P(j)  *  h,  where  =  max{a^lisQj  HQR}. 

R  R 

Otherwise,  let  cp( j )  *  k,  where  eft.  ■  min  a. . 

i«Qj 

R  R 

Once  cp(j)  is  selected,  set  R  *-  R U  £cp( j ) 3 ,  update  and  <Zq»  as 

well  as  Qr,  Qr  and  Q°  (combining  variables,  if  necessary),  and  proceed  to 
the  next  jeN"'M.  This  choice  is  again  consistent  with  the  requirement  that 
■■o  e  5"(x°). 


Having  generated  the  linear  inequality,  we  eliminate  the  complemented 
variables,  i.e.,  restate  the  inequality  in  the  original  variables,  and  add 
it  to  the  current  linear  0-1  program. 

Next  we  illustrate  the  procedure  on  an  example. 

Example  4.  Consider  the  multilinear  inequality 

(19)  16x2x^Xj  -  10x2x6  +  lOx^Xj  +  5x^x^  -  4X5X7  +  4X3X5  <  1, 

which  is  violated  by  x°  =  (1,1, 1,0, 1,1,0) .  We  have  =  {2,4,5},  Q2  =  {2,6}, 
Q3  =  {1,2,3},  Q4  =  {1,5},  Q5  =  {5,7},  Q6  =  {3,5}.  Further,  N+  =  {l,3,4,6}, 

N'  =  {2,5},  and  P+(x°)  =  {3,4,6},  P'(x°)  =  {5},  P(x°)  =*  {3, 4, 5, 6}. 

The  corresponding  inequality  with  positive  coefficients  is  (in  general 

form) 

V40)„,  16x2x4x5  +  10x{p(2)  +  10Xlx2x3  +  5x^5  +  4*^  +  4x3x5  <  15, 

where  cp(2)  and  cp(5)  depend  on  the  choice  of  V  e  $  (x°). 

1.  We  identify  the  minimal  cover  M  =  {3,4,5}  for  (19)»  which  is  also 
a  minimal  cover  for  (20)^.  We  then  choose  <p(5)  ■  7  and  thus  obtain 

Vra*  =  ^mpn"  = 

Applying  Theorem  1  to  (20),n,  we  derive  from  the  minimal  cover  M  the 
generalized  covering  inequality 

(21)  X1  +  x2  +  X3  +  X5  +  x^  >  1 

violated  by  x°. 

2.  We  identify  the  sets  EQ(M)+  =  {3,4,6},  E]L(M)+  «  {l},  and  since 

E  (M)+  =  0  for  i  >  2,  we  have  R  *  MUE(M)+  -  {1,3,4, 5, 6},  QD  -  {1,2, 3, 4, 5,7} 


3.  For  j  *  2  (JeN”\R),  we  set  q>(2)  *  6,  since  Q2  XQR  =  C^},  and 
update  R  by  including  {2}.  Thus  R  ■  [1,2, 3, 4, 5, 6},  and  by  applying 
Theorem  1  to  (20)^  (with  cp( 2 )  =  6  and  cp(5)  *  7),  we  obtain  from  the  extended 
cover  R  the  inequality 

15x^  +  26xj  +  14x^  +  16x^  +  25x5  +  10xfi  +  4x^  >  34 

which  is  also  violated  by  x°,  and  which  strictly  c-dominates  the  generalized 
covering  inequality  (21). || 

As  mentioned  earlier,  we  found  it  necessary  to  periodically  remove 
inequalities  from  the  linear  0-1  program  in  order  to  keep  its  size  within 
manageable  limits.  The  cut  dropping  procedure  operates  as  follows.  The  set  V 
of  all  inequalities  generated  during  the  procedure  is  partitioned  into  three 
subsets.  contains  exactly  one  inequality  generated  at  each  iteration, 
namely  the  one  derived  from  the  most  violated  constraint  of  (MLP).  Cuts  in 
are  never  removed,  as  a  guarantee  that  every  solution  to  the  linear  0-1 

program  generated  during  the  procedure  is  cut  off  by  at  least  one  inequality. 
V2  consists  of  all  inequalities  associated  with  extended  covers  and  not 
contained  in  V^,  whereas  consists  of  the  remaining  inequalities  (i.e., 
those  associated  with  minimal  covers  that  could  not  be  extended). 

Whenever  the  number  of  inequalities  in  the  linear  0-1  program  attains 
a  predetermined  threshold  value  4,  all  inequalities  in  not  binding  at  the 
current  solution  are  dropped.  The  subset  is  our  first  preference  for 
dropping,  since  it  usually  consists  of  the  weakest  inequalities  of  the  current 
system.  If  removing  the  nonbinding  inequalities  in  is  not  sufficient  for 
accommodating  all  the  inequalities  generated  at  the  current  iteration,  then 
the  nonbinding  inequalities  in  are  also  dropped.  Finally,  if  removing  all 


Che  nonbinding  inequalities  of  and  is  still  Insufficient,  we  drop  an 
appropriate  number  of  binding  inequalities  in  and,  if  necessary,  in  V^. 

This  completes  the  description  of  the  main  version  of  our  algorithm, 
henceforth  called  Algorithm  I.  Two  additional  versions  of  the  algorithm  were 
implemented,  which  will  now  be  briefly  described. 

Algorithm  II  differs  from  Algorithm  I  in  that  it  generates  linear 
inequalities  not  directly  from  an  inequality  (2)  of  (MLP) ,  but  from  an  extended 
canonical  inequality  implied  by  (2)^,  as  described  at  the  end  of  section  2. 

The  choice  of  the  inequality  (2),  respectively  (2)y,  as  well  as  that  of  the 
minimal  cover  M,  is  the  same  as  in  Algorithm  I.  Another  minimal  cover  C  Is 
then  identified,  such  that  |c|  =  |m|  and  £(M)  c£(C)  (preferably,  but  not 
necessarily,  C  ^  M) .  The  cut  generating  procedure  described  above  is  then 
applied  to  the  canonical  inequality  defined  by  £(M)  and  expressed  in  terms 

of  x,  for  which  M  is  still  a  minimal  cover.  Everything  else  is  as  in  Algorithm  I. 

Finally,  Algorithm  III  differs  from  the  other  two  versions  by  the 
fact  that  it  derives  only  generalized  covering  inequalities  corresponding  to 
minimal  covers  without  attempting  to  strengthen  them  by  extending  the  covers. 

For  this  version,  the  choice  of  the  minimal  cover  is  done  differently,  namely 
by  setting  M  =  {i^,...,i^},  where  k  is  the  smallest  integer  such  that  M  is 
a  cover.  As  a  result,  M  (which  is  of  course  minimal)  is  of  smaller  cardinality 
than  the  cover  selected  in  Algorithm  1  which  in  the  absence  of  the  extension 
procedure  is  preferable.  The  superiority  of  this  choice  of  minimal  cover  for  this 
particular  algorithm  was  unequivocally  supported  in  the  computational  testing. 

The  other  ingredients  of  Algorithm  III  are  the  same  as  those  of  I  and  II. 

Algorithm  III  may  be  viewed  as  our  version  of  the  algorithm  of  Granot  and  Granot 
[9] ;  the  differences  from  the  latter  (improvements  in  our  view)  having  been 
adopted  in  order  to  make  it  comparable  with  Algorithms  I  and  II. 


Algorithm  1,  which  for  all  but  very  sparse  problems  is  the  most 
efficient  of  the  three  procedures  implemented,  was  also  run  in  the  heuristic 
mode,  i.e.,  by  removing  all  steps  subsequent  to  the  finding  of  a  feasible  solu¬ 
tion  to  (MLP) .  The  purpose  of  this  exercise  was  to  obtain  information  on  the 
quality  of  the  solutions  obtainable  by  such  an  approach. 

4.  Computational  Results 

The  algorithms  discussed  above  were  coded  in  FORTRAN  and  tested  on  a 
series  of  randomly  generated  test  problems,  using  an  IBM  3081  Model  K  computer 
and  a  FORTRAN  H  level  compiler. 

The  first  set  of  test  problems  consists  of  30  multilinear  0-1 

programs,  5  in  each  of  6  classes  that  differ  among  themselves  in  the  number 
of  terms  per  constraint.  The  number  of  constraints  and  variables  (denoted  by 

m  and  n  respectively)  is  the  same  in  all  of  these  problems  (m  *  10,  n  =  30), 

and  the  number  of  terms  per  constraint  is  randomly  drawn  from  a  uniform 

distribution  on  the  interval  [3,  T] ,  where  T  is  shown  in  Table  1.  The 

constraint  coefficients  a  are  Integers  uniformly  distributed  on  [-  5,  15], 

while  the  are  integers  drawn  from  a  uniform  distribution  on  (0.3sk,  0.8sk), 

where  s^  =  E^a^.  The  cost  functions  are  linear,  with  integer  coefficients 

uniformly  distributed  on  [1,  20].  Finally,  the  number  of  variables  per  term 

is  uniformly  distributed  on  [2,  6].  The  results  are  shown  in  Table  1.  Our 

remaining  55  test  problems  were  generated  in  the  same  manner  as  the  first  set, 

with  the  values  of  m,  n  and  T  as  indicated  in  the  tables.  The  test  problems 

are  available  upon  request.  Algorithm  1  was  also  tested  on  a  set  of  problems 

from  the  literature. 

All  test  problems  were  run  under  two  kinds  of  limitations  (as  Indicated 


in  the  tables):  a  time  limit  (1  or  5  minutes,  depending  on  the  phenomenon 


studied)  and  a  limit  (150  or  200)  on  the  number  of  iterations,  hence  on  the 
number  of  nonremovable  Inequalities  generated,  due  to  space  limitations.  The 
latter  limit  is  different  from  the  threshold  value  A  that  triggers  the  cut 
dropping  routine.  In  Algorithms  I  and  II,  after  some  experimentation  A  was  set 
to  2n,  i.e.,  twice  the  number  of  variables;  whereas  in  Algorithm  III  computational 
tests  indicated  a  higher  value,  and  A  was  set  equal  to  the  maximum  number  of 
iterations  (150  or  200). 

All  CPU  times  reported  are  exclusive  of  input/output  time.  The 
maximum  input  time  for  any  of  the  test  problems  was  0.02  seconds. 
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Table  1.  Number  of  problems  solved  and  average  CPU  time  (seconds).  ’  * 


I 

Algorithm  I 

Algorithm  II 

Algorithm  III 

m 

n 

T  i 

No.  solved  Time 

No,  solved  Time 

_ i 

No.  solved  Time 

10 

30 

10 

5 

2.6 

5 

1.3 

5 

0.6 

10 

30 

20 

5 

0.2 

5 

0.2 

5 

0.2 

10 

30 

30 

5 

2.8 

5 

10.8 

5 

14.6 

10 

30 

40 

5 

2.6 

!  3 

24.6 

3 

24.8 

10 

30 

50 

5 

8.5 

|  3 

33.2 

2 

29.9 

10 

30 

60 

5 

4.5 

4 

25.2 

2 

26.9 

1.  5  problems  per  class. 

2.  Limit  set  to  1  minute  CPU  time  or  150  iterations  per  problem. 

3.  Time  averaged  for  all  5  problems.  Time  for  problems  not  solved 
within  1  minute  taken  to  be  1  minute  . 

Table  1  shows  that  although  Algorithm  III  performs  somewhat  better  than 
Algorithm  I  on  the  problems  with  T  *  10  and  T  *  20  (i.e.,  with  6  and  12 
constraints  on  the  average,  respectively),  its  performance  quickly  deteriorates 


for  higher  values  of  T,  as  reflected  in  the  sharply  decreasing  number  of 
problems  solved  within  the  limits  allowed.  This  concurs  with  the  observation 
of  Granot,  Granot,  and  Vaessen  [11]  that  for  their  algorithm  (which  performs 
phenomenally  well  on  sparse  problems),  CPU  time  appears  to  grow  exponentially 
with  T.  At  the  same  time,  the  performance  of  Algorithm  I  is  only  moderately 
affected  by  the  increase  of  T.  As  for  Algorithm  II,  its  performance  is  not 
better  than  that  of  III  on  the  problems  with  small  T,  and  considerably  worse 
than  that  of  Algorithm  I  on  the  problems  with  large  T.  Thus  the  perfornun  „e 
of  Algorithm  II  will  not  be  further  pursued. 

Table  2  compares  the  performance  of  Algorithms  I  and  III  on  the  same 
set  of  problems  with  the  time  and  iteration  limits  for  Algorithm  III  increased 
to  5  minutes  and  200  iterations,  respectively. 

Table  2.  Number  of  problems  solved  and  average  CPU  time  (seconds).1 


j  Algorithm  I 2 

Algorithm  m3 

m 

n 

T 

No.  solved 

Time 

No.  solved 

Time 

10 

30 

10 

5 

2.6 

5 

0.6 

10 

30 

20 

5 

0.2 

5 

0.2 

10 

30 

30 

5 

2.8 

5 

14.6 

10 

30 

40 

5 

2.6 

4 

111.2 

10 

30 

50 

5 

8.5 

! 

3 

l 

91.5 

10 

30 

60 

1  5 

4.5 

;  4 

76.9 

1.  5  problems  per  class.  Time  averaged  for  all  5  problems. 

2.  Limit  set  to  1  minute  or  150  iterations  per  problem. 


3.  Limit  set  to  5  minutes  or  200  Iterations  per  problem.  Time 
for  problems  not  solved  within  5  minutes  taken  to  be  5  minutes 


The  results  show  an  even  sharper  contrast  between  the  sensitivity  of 


the  two  algorithms  to  an  Increase  In  the  number  of  terms  per  constraints. 

We  conclude  that  the  more  compact  linearization  based  on  the  theory  of 
section  2  definitely  pays  off  for  problems  with  more  than  12-15  terms  per 
constraint. 

In  Table  3  we  compare  the  average  number  of  iterations  and  cuts 
(linear  inequalities)  generated,  in  order  to  better  understand  the  difference 
in  the  performance  of  the  two  algorithms.  We  see  that  as  T  is  increased 
from,  say,  30  to  60,  the  number  of  iterations  and  cuts  increases  by  more 
than  400%  for  Algorithm  III,  as  opposed  to  8-17%  for  Algorithm  I.  On  the 
other  hand,  while  the  percentage  of  covers  that  can  be  extended  (in  Algorithm  I) 


Table  3.  Number  of  iterations  and  of  cuts. 


Algorithm  III: 


Iterations  Cuts 


10 

30 

10 

10 

30 

20 

10 

30 

30 

10 

30 

40 

10 

30 

50 

10 

30 

60 

5.8 

30. 

4.0 

25. 

8.4 

39. 

9.6 

40. 

12.0 

46. 

|  9.8 

42. 

Percent  covers  !  Iterations  Cuts 
extended 


5  problems  per  class.  Values  averaged  for  all  5  problems. 
Limit  set  to  1  minute  or  150  iterations  per  problem. 

I.  Limit  set  to  5  minutes  or  200  iterations  per  problem. 

>.  Only  4  problems  solved  to  optimality, 
i.  Only  3  problems  solved  to  optimality. 


increases  with  T,  Che  increase  is  only  modest,  since  this  percentage  is  high 
to  begin  with  (i.e.,  for  all  problem  classes).  This  modest  increase  cannot 
fully  account  for  the  sharply  increasing  difference  in  the  number  of  iterations 
required  by  the  two  Algorithms.  What  the  table  does  not  show,  however,  is 
that  as  the  number  of  terms  per  constraint  increases,  not  only  does  the  per¬ 
centage  of  covers  that  can  be  extended  increase,  but  more  importantly,  there 
is  a  significant  increase  in  the  extent  to  which  every  minimal  cover  can 
be  extended:  with  more  terms  per  constraint,  many  more  indices  are  included 
in  the  extension  of  each  cover. 

In  Tables  4  and  5  we  illustrate  the  effect  of  an  increase  in  the  number 
of  variables  and  constraints,  respectively,  on  the  performance  of  Algorithm  I. 

Table  4.  Effect  of  an  increase  in  the  number  of  variables  (Algorithm  I)1 


m 

n 

T 

No.  solved 

1  Time 

J  (seconds) 

Iterations 

1 

Cuts 

Percent  covers 
extended 

10 

30 

30 

5 

2.8 

! 

8.4 

i  i 

39.4 

95.3 

10 

40 

30 

5 

1 

|  6.4 

11.8 

44.2  j 

96.5 

10 

50 

30 

5 

17.7 

1  11.4 

45.2 

96.3 

1.  5  problems  per  class. 
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Table  5.  Effect  of  an  Increase  In  the  number  of  constraints  (Algorithm  I)  *  * 


m 

n 

■ 

J  No.  solved 

i 

Time 

(seconds) 

Iterations 

Cuts 

1 

Percent  covers 
extended 

5 

30 

30 

5 

0.4 

5.8 

i 

I  17.0 

95.1 

10 

30 

30 

5 

2.8 

8.4 

39.4 

j 

95.3 

15 

30 

30 

i 

!  ^ 

75.2 

14.8 

I 

81.4 

j  95.3 

20 

30 

30 

5 

40.7 

!  22.2 

109.6 

92.6 

1.  5  problems  per  class. 

2.  Limit  set  to  5  minutes  or  150  iterations  per  problem. 

3.  Values  averaged  for  all  5  problems.  Time  for  problems  not  solved 
within  5  minutes  taken  to  be  5  minutes . 


Table  4  shows  that  as  the  number  of  variables  increases  from  30  to  50, 
there  is  a  corresponding  increase  in  the  time  required  to  solve  the  problems. 

This  is  of  course  to  be  expected,  since  the  number  of  variables  increases  to 
the  same  extent  in  the  linear  0-1  program  as  in  (MLP) .  Note,  however,  that 
the  number  of  iterations  increases  by  only  about  1/3  as  the  number  of  variables 
increases  three  times.  Table  5  shows  a  marked  increase  in  computing  time 
as  well  as  the  number  of  iterations  and  cuts  as  the  number  of  constraints 
Increases.  This  is  due  to  the  fact  that  the  number  of  inequalities  in  the 
linear  equivalent  of  (MLP)  sharply  rises  with  the  number  of  constraints  of 
(MLP),  hence  so  does  the  number  of  iterations  required  to  generate  an  appropriate 
subset  of  the  linear  inequalities. 

Algorithm  I  was  also  tested  on  the  series  of  problems  solved  by  Taha 
[21].  Although  these  problems  are  not  large  and  have  relatively  few  terms  per 


34 


t’ 

constraint,  we  ran  them  in  order  to  observe  the  performance  of  the  algorithm  q 

on  a  known  set  of  multilinear  0-1  problems  with  nonlinear  objective  functions. 

As  described  in  section  3,  we  chose  to  linearize  the  objective  function  by 
introducing  one  new  constraint  and  an  appropriate  number  of  new  0-1  variables.  ^ 

The  results  of  this  test  are  reported  in  Table  6.  The  symbols  m  and  n  denote 
the  number  of  constraints  and  variables,  respectively,  of  the  original  prob¬ 
lems  (before  the  above  mentioned  transformation).  Problem  2C,  which  took  41.4  I 

seconds  to  solve,  seems  to  be  very  tightly  constrained. 


Table  6.  Algorithm  1  tested  on  Taha's  [21]  problems 


; 

B 

0) 

r—4 

•o 

o 

m  ! 

n 

l 

Average  no.  of 
terms  per  1 

constraint 

Time 

(seconds) 

Iterations 

Percent 

covers 

extended 

1A 

3 

5 

4.3 

0.02 

! 

4 

75.0 

IB 

3 

10 

4.3 

0.36 

| 

36 

16.2 

1C 

3 

|  20 

4.3 

5.42 

! 

56 

9.4 

2A 

; 

7  ; 

1  , 

!  5 

6 

!  0.07 

5 

82.8 

2B 

t 

7  1 

10 

6 

0.15 

6 

69.2 

2C 

7 

20 

6 

41.40 

91 

42.6 

2D 

7 

30 

6 

6.81 

37 

46.1 

2E 

■ 

7 

5 

6 

1 

0.03 

1 

100.0 

3A 

6 

10 

4.7 

0.02 

2 

100.0 

3B 

6 

10 

4.7 

i  0.02 

1 

3 

100.0 

3C 

6 

10 

4.7 

0.04 

! 

6 

3D 

6 

10 

4.7 

0.18 

9 

95.8 

3E 

6 

10 

4.7 

0.17 

8 

j  100.0 

t 


P 


P 


36 


actual  optimum.  For  the  problems  of  Table  8  this  is  not  the  case,  and  the 
only  measure  available  is  the  LP  bound.  On  both  counts,  the  quality  of  the 
solutions  obtained  by  using  Algorithm  I  in  the  heuristic  mode  seems  excellent 
and  the  computational  effort  is  modest. 


Table  8.  Additional  tests  with  the  heuristic^ 


m 

n 

■ 

No.  solved 

Iterations 

( 

i 

Time 

(seconds) 

J 

-  - 

Proximity 
to  LP 
bound 

a) 

To” 

30 

70 

5 

23.8 

1.4 

2.8 

10 

40 

30 

5 

10.4 

1.0 

3.0 

10 

50 

30 

5 

11.2 

1.9 

1.8 

10 

50 

40 

5 

14.0 

3.3 

1.8 

10 

50 

50 

5 

9.0 

1.2 

1.6 

5 

100 

30 

5 

7.0 

0.6 

0.4 

5 

150 

30 

5 

6.4 

1.0 

0.4 

5 

100 

50 

5 

15.4 

6.2 

0.8 

1.  5  problems  per  class.  Values  averaged  for  all  5  problems. 


We  conclude  from  this  computational  study  that  Algorithm  I,  based 
on  the  linearization  of  [6]  and  section  2  is  an  efficient  procedure  for  solving 
multilinear  0-1  programs  to  optimality.  In  particular,  problems  having  more 
than  20  terms  per  constraint  have  now  been  opened  up  to  exact  solution.  The 
use  of  the  first  phase  of  the  algorithm  as  a  heuristic  is  also  an  attractive 
option  for  problems  with  many  constraints  and/or  variables,  in  that  high 
quality  solutions  can  be  obtained  at  a  modest  computational  cost. 
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